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Abstract 



We study the minimal complexity of tilings of a plane with a given tile set. We note that every tile 
set admits either no tiling or some tiling with €^{n) Kolmogorov complexity of its (« x «)-squares. We 

'^ , construct tile sets for which this bound is tight: all (n x n)-squares in all tilings have complexity at least 

n. This adds a quantitative angle to classical results on non-recursivity of tilings - that we also develop 
in terms of Turing degrees of unsolvability. 

^^ ' Keywords; Tilings, Kolmogorov complexity, recursion theory 

Q ; 1 Introduction 

^f-N ! Tilings have been used intensively as powerful tools in various fields such as mathematical logic (see, 

^ ' e.g., [sBorger Gradel Gurevich 96] and references within), complexity theory MGurevich 911ILevin 861 . or in 

oo ■ ■ 

o 



physics for studying quasicrystals (see for instance the review paper linger sent 91 1). In all of these branches 



Q , the ability of tile sets to generate "complicated" tilings is essential — it was already clear in Wang's original 



t^^ I papers [ |Wang 6 1 [ |Wang 62 1 . 

^-^ ' A tile is an unit square with colored edges (each of the four sides has some color). Assume that a finite 

set T of tiles is given. We want to form a T-tiling, i.e., to cover plane with translated copies of tiles from T in 

^ I such a way that adjacent tiles have a common edge which has the same color in both tiles. 

J-^ ' Tiles placed in the plane can be seen as a dual view of crosses on a grid. A cross in a grid is a combination 

of four (colored) edges sharing a corner Given a set of allowed crosses, one may wish to color all edges of a 

k> ', grid in such a way that all crosses are allowed. This question is equivalent to the original one. (Turning each 

^ I edge orthogonally around its own center turns the grid of edges into its dual graph and tiles into crosses and 

vice versa.) Thus, one can use either representation for best visual advantages. 

We call a. palette a finite set of tiles that can be used to tile the plane {+palette for crosses). The problem 
to know whether a set of tiles is or is not a palette, is the so-called domino problem. 



In order to prove its undecidability left open in |Wang 61 Wang 62 1, Berger |Berger 66 1 constructed 



an aperiodic set of tiles, i.e., a palette T such that all T-tilings are aperiodic (no translation keeps them 
unchanged) (see also I Robinson 7111 and MAUauzen Durand 96.1 ). 
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Hanf in MHanf 7411 (for the origin constrained case) and then Myers in [Myers 74| (for the general case) 



have strengthened this result and constructed a palette that has only non-computable (non-recursive) tilings. 

The aim of this paper is to understand how "complexity-demanding" a palette can be, and we measure 
the complexity of a palette by the minimal Kolmogorov complexity of tiling it can form. More specifically, 
we measure the complexity of regions in the simplest tiling that can be formed (a formal definition is given 
in the next section). 

Some information about the complexity of tiling from the recursion-theoretic viewpoint is also provided 
(section nri). 

What can be said about Kolmogorov complexity of a tiling? Tiling is an infinite object, so we look at 
{n X ?2)-squares and measure their Kolmogorov complexity. 

Item [T] of Theorem [T] below states that for each palette there exists a tiling such that complexity of its 
{n X M)-squares is ^(«). This bound is tight: item|2j our main result, constructs a palette T that has only 
complex tilings: in each tiling, every {n x ?i)-square has complexity at least n. The construction is rather 



complicated and is based on Berger's construction in |Berger 66 1 and its further developments 



If T is a palette with all tilings of at least linear complexity, then all T-tilings are aperiodic and non- 
computable because for every computable (a fortiori periodic) tiling, the complexity of its centered {n x n)- 
squares is ^(log«). 

Note that the right question is "what is the minimal complexity of a T-tiling" (for a given palette t) but 
not "what is the maximal complexity of a T-tiling". Indeed, the maximal complexity could be large for a 
trivial T such as the set of all tiles having black and white edges where random tiling has complexity D.{n'^). 

Theorem [U uses the same idea of embedding computations into tilings that was used to construct palette 
that has only non-computable tilings (IIHanf 741|Myers 741). However, in our case we need embedding that 



is "dense" enough, and its construction (in non-constrained case) requires additional efforts. 

It seems likely to one of us that Kurdiumov-Gacs hierarchical cellular automata (see, e.g., UGacs Oil ) 
could be used instead of Berger's square hierarchy. This way a stronger result (allowing a constant fraction 
of missing tiles in random places) might possibly be achieved. We, however, are confident in our inability to 
use these (enormously complex) constructions and, in any case, the simplicity of the structure we propose 
has independent merits. 

A more structural approach can be used to handle the complexity of tilings: a palette can always form 
"quasiperiodic" tilings (see MDurand 991 ). We can measure the regularity of quasiperiodic tiling by the 
growth of the function assigning to an integer n the minimal "window" size in which all patterns smaller 
than nxn must appear (for every position of the window and for all patterns that appear somewhere in the 
tiling). This approach was further developed in [ Cervelle Durand 00,1 . 

Theorem [T] also implies lower and upper bounds for the number of different {n x «)-squares in a tiling 
(Corollary [B. 

Let us make some remarks about the complexity of tilings from the viewpoint of hierarchy of Turing- 
degrees of unsolvability. Hanf and Myers result in IIHanf 74.|Myers 74 J says that some palettes can generate 
only non-recursive tilings (i.e., of degree > 0). This cannot be improved significantly: we cannot find a 
palette for which all tilings are, say, O'-hard, since for every palette T, and undecidable set A, there exists a 
T-tiling T such that A is not Turing-reducible to T. This result is a corollary of classical results in recursion 
theory because the set of all tilings with a given palette is a Ilj-set (see Odifreddi book p. 508 [ Qdifreddi 89 J 
and references withiio). However, we present (see Proposition O a short direct proof of this fact (that goes 
back to Albert Muchnik and Elena Dyment and was communicated to us by Andrei Muchnik BMuchnik 0011 ). 



'Thanks to Frank Stephan for references. 



2 The Main Results 

There are several versions of Kolmogorov complexity K(x) expressing "the minimal description length" 



(see I Li Vitanyi 97 1). For our purposes it does not matter which of them we use. 

Theorem 1 

1. For each palette T, there exists a z-tiling in which all nxn squares n have complexity 0'{n). 

2. There exists a palette T such that in every z-tiling all nxn squares have complexity > n. 

(The second part can be slightly generalized. A pattern on a connected subset P of a tiled planar grid 
is the list of tiles in P and their coordinates relative to the center of P. We encode all objects x in binary 
denoting their length as ||.x||. In Theorem 1 1121 we can replace nxn squares by patterns of diameter n.) 

Item[T]of this Theorem and the following Corollary are proven in section[3] The proof of item[2]involves 
several constructions and will be split into several parts. Section |4] considers the easier origin-constrained 
case. Section |5] describes aperiodic tilings used as a background in the rest of the proof. Section [6] explains 
the general structure of the computation embedded in a tiling; Section [8] considers computational power of 
stripes (modules of different ranks that interact during the computation). Finally, section |9] considers the 
communication between stripes and explains how all the stripes working in parallel achieve the declared 
goal (preventing low-complexity fragments from appearing in the tiling). 

Corollary 1 Let D„{a) be the number of different nxn squares that appear in tiling a. 

1. Each palette z has a z-tiling a such that D„{a) = 2^^">. 

2. There exists a palette z such that D„{a) > 2" for every z-tiling a and every n. 

(See section [3] for the proof.) 

Theorem[T]has a finitary version that says, informally speaking, that (for some palette) a pattern x whose 
complexity is less than its diameter d cannot appear msiN x A/^-square where N is the polynomial of the 
time needed to establish that K(x) < d. 

Let U : p ^ xhe, the universal algorithm defining Kolmogorov Complexity K(x) of x as the minimal 
length of its co-image p. Let U'{p) = {U{p), \\p\\) enumerate the super-graph of K. Let Tk{x) be the optimal 
inversion time of U' on {x,k) and Sk{x) be the minimal space U{p) needs to compute each digit of x from 
some;? e {0)1}'^- 

Theorem 2 1. Every palette z, for each N,k> K{N) + 0(1), has z-tiled N xN squares x 
with K(x) < k and Sk{x) = 0{N) +Sk{N). 

2. There exists a palette z such that no pattern x of diameter d > K(x) can be extended to a z-tiled 
square of diameter T^^x)^. 

See Section [To] for the proof. 



3 Proof: the Upper Bound (Theorem [HI]) 

Proof of the upper bound. 

Fix a palette T. A border coloring b of a. {n x «)-square assigns colors to 4n tile sides on the square 
border. A border coloring b is called consistent if it can be extended to a tiling of the entire (« x ?i)-square, 
i.e., there exists a tiling of {n x ?i)-square that matches b. Consider the following algorithm that, applied to a 
consistent border coloring of a square of size nxn where n = 2^, extends it to the tiling of the entire square: 

A. Find the alphabetically first coloring of the central lines dividing the square into four equal squares 
such that all four squares get a consistent border coloring. 

B. Apply the algorithm recursively to four border colorings of smaller squares. (For (1 x l)-square 
consistent border coloring is just a tile coloring.) 

When this algorithm is applied to a square with side 2*, it generates a tree of recursive calls for sub- 
squares with sides 2' for all I ("standard" sub-squares). On each standard sub-square the complexity of tiling 
is proportional to square side (since tiling is computed by our algorithm starting from border coloring). 

Each non-standard sub-square with side m is contained in 4 standard sub-squares with sides smaller than 
2m and therefore has complexity &{m). This argument shows that for some constant c and for all k there 
exists a tiling of size 2*^ x 2^ such that all (m x m) -sub-squares in this tiling have complexity at most cm. 

Using compactness argument, we conclude that there exists an infinite tiling with the same property. 

(Here are the details. For a fixed c let us call a tiling of {n x ?i)-square good if all (m x m)-subsquares of it 
have complexity at most cm. As we have seen, for some c there exist good [n x «)-tilings for arbitrarily large 
n. Call a tiling of [n x ?i)-square extendible if it appears as a central part of some good tiling of arbitrary large 
size. Note that each extendible tiling can be extended to some extendible tiling of (« + 2) x (« + 2) -square 
by adding one more layer. Continuing this process, we get a tiling of the entire plane.) D 

Proof of the Corollary. The first statement of Corollary [T] is a direct consequence of upper bound in Theo- 
remlH since the number of different objects with complexity i?{n) is 2*'"'. 

To prove the second statement we use the lower bound from Theorem [T] Let T be the palette such that 
all T-tilings have complexity at least 5k for {k x /c)-squares. (We have weaker bound k in Theorem [T] but it 
does not matter since we can combine several tiles into one larger tile.) 

Let a be a T-tiling. Assume that for some n the number of {n x ?i)-squares in a is less than 2". Consider 
a square of size kxk where ^ is a large multiple of n, and its "border" formed by {n x ?i)-squares. Since each 
border square can be described by n bits (there are less than 2" of them), the whole border has complexity 
approximately Ak (for large k). Then we can change the tiling, replacing the interior of {k x /c)-square by the 
alphabetically first tiling that is compatible with the border. Then new interior is determined by the border, 
therefore the complexity of new {k x /:) -square is less than 5^ and this contradicts to our lower bound (that 
is vaUd for all tiUngs). D 



4 Proof: Origin Constrained Case 

To prove the lower bound, we start with the much simpler "origin constrained case". It means that we 
consider only those tilings of the plane that have a fixed tile at the origin. This allows us to enforce the tiling 
to be a time-space diagram of a Turing machine. 

4.1 Computation Performed 

Let us agree that each horizontal line in a tiling represents a Turing machine's tape at time t where t is the 
vertical position of that line. The tile used at position (x,?) encodes the contents of cell number x at time t 
(including the head state if the head is inside cell x at time t). 

The rules of Turing machine are local and therefore can be encoded in terms of tilings (one may represent 
overlapping groups of cells on time-space diagram by a tile). This technique is well known (see, e.g., 
[Wang 61]|) and we won't go into details here. It works only for constrained case; we require the origin to 



be the tile that contains head of TM, otherwise a tiling may contain no computation. 

Since tilings can simulate the behavior of a TM with an infinite tape, it remains to construct a TM that 
will ensure high complexity of its time-space diagram. 

Imagine that we have a TM with a double tape: each cell is the Cartesian product of a workspace and an 
"input bit". The TM may change only the workspace of each cell, the input bit is read-only. This TM can 
checks that input sequence is "complex enough", that is, its input string has Kolmogorov complexity at least 
ck for a constant c < 1 in each k consecutive columns. More precisely, the set of all finite strings with low 
Kolmogorov complexity is enumerable (we can try all the programs in parallel and look for the cases when 
the output of a program is significantly longer than the program itself). Our TM can enumerate such simple 
finite strings, compare them with segments of the input tape, rejecting the tiling if any match is found. 

This addresses Theorem I1I2I for patterns of width (equal to the number of input bits) close to their di- 
ameter. For narrow patterns we must superimpose two orthogonal copies of this construction. This suffices, 
since diameter of any pattern equals, within a factor of 2, to either its width or height. 

We need now to prove existence of sequences our machine does not reject. 

4.2 Complexity Lemma 

Lemma 1 For each c < 1 there exists a binary sequence (0 with H{x) > c\\x\\ — ^{\)for all its substrings x. 

Remark 1. For our purposes it is enough to prove this lemma for some positive c (however small). Still, 
the more general statement (for all c < 1) is of some independent interest, so we prove it in this stronger 
form. We cannot strengthen this Lemma further since for each sequence (0 the above inequality fails for 
some c < 1 and an infinite set of substrings of unbounded lengths. (If every binary string is a substring of 
CO, then this is evident. If some string X does not appear in ft), then the bound K(x) < c||x|| + ^(1) is true 
for some c and for each substring xoi CO.) 

Remark 2. It is not important which version of complexity to use in the lemma since c is not fixed and 
all versions differ by a logarithmic term. However, in the proof it is convenient to use prefix complexity. 

Remark 3. In this lemma we speak about sequences that are infinite in one direction (though the 
sequence of indices on the tape is bi-infinite). However, this is not important: if there exists an infinite in 
one direction sequence with this property, there are arbitrary long finite sequences with this property, and 
the standard compactness argument shows that there are bi-infinite sequences with this property. 

[In fact, compactness is not even needed here. We can construct a bi-infinite sequence with this property 
from a one-way infinite one by putting bits alternatively left and right at the small cost of a multiplicative 
factor 2 on (1 — c).] 



Thus our lemma proves that the above constructed TM does not halt for some input sequences (having 
this property)o 

Proof of Lemma E] 

Let us prove first for some constants d ,c'' that for every string x and natural number n there exists an 
n-hit string y such that 

KP{xy) + KP{n) +c > KP{{x,y)) + c" > KP{x) + n 

Here {x,y) stands for the encoding of the ordered pair formed by x and y. The second inequality is true since 
of 2" such pairs with a given x some must have a universal semimeasure smaller than x at least by a factor 
of 2" and thus an n bits higher complexity. 

And the first inequality is true since {x,y) can be reconstructed from xy and \\y\\ =n. 

Now we can prove the lemma as follows. For a given c < 1 we choose m such that 

m — KP{m) —c'> cm. 

Then, starting with an empty sequence, we add blocks of length m to it in such a way that each block 
increases the complexity at least by an. Adding several blocks, we increase the length by some M (which is 
a multiple of m) and the complexity at least by cM. Since 

KP{uv) <KP{{u,v)) + 0{\) <KP{u)+KP{v)+c"\ 

the group of added blocks has complexity at least cM — c'" . Thus we have proved our Lemma for segments 
that start and end at coordinates that are multiples of m. The boundary effects can be compensated by a 
small change in c. D 

5 Proof: Self-similar Pattern 

Now we have to consider the general case, no more requiring a fixed tile at the origin. Let us start with some 
informal remarks. The palette must prevent individual tilings from being periodic. This can be provided by 
a "self-similar" structure: tiling is divided into "mega-tiles" — blocks of large sizes (squares of size 2" x 2" 
for all n) that behave like individual tiles. 

A self-similarity of this type was used in Robinson's construction of an aperiodic tiUng (see Robinson's 
original paper BRobinso n 711 and an exposition given in MAUauzen Durand 96ll ). A slightly more rigid con- 
struction (where all "mega-tiles" are aligned, which was not the case for Robinson's palette), is explained 
in MLevin 041 and IIDurand Levin Shen 041 . We do not repeat the latter construction here but just describe 
the self-similar pattern that can be enforced by it. 

Consider a grid of 2 x 2 squares separated by two cells (Fig.[T]l. 

Then group these squares into groups of four squares whose centers form a twice larger square (Fig. |2ll. 
We get a rank 2 grid formed by (4 x 4)-squares separated by four cells; this grid is twice larger than the rank 
1 grid. 

Then we group rank 2 squares into groups of four squares whose centers are comers of rank 3 square 
etc. We will refer to the edges on the borders of squares of all ranks as dark. (Fig.[3]shows one rank 4 square 
and underlying hieraixhy of smaller squares.) 



■^Note that time-space diagram occupies only the upper half-plane where time is positive, but this does not matter since high 
complexity of squares is guaranteed by input bits which propagate vertically in both directions. Similarly in extended abstract of 
this article (STOC 2001 fPurand Levin Shen Oil ) the complexity of all squares was assured by each square propagating its input 
bits vertically, horizontally, and diagonally. (The last direction of propagation was among many details missing in that abstract. It 
referred to the version posted at arXiv.org simultaneously with STOC 2001 for more details; now, we give an entirely different, and 
simpler, proof of a stronger result.) 



Figure 1: Rank 1 squares 



Figure 2: Rank 2 squares 



Figure 3: Hierarchy of squares 



Note that we have described not one specific pattern but an uncountable family of patterns: at each 
rank we have a two-bit choice while grouping squares into 4-groups. Therefore, a pattern (together with a 
specified cell in it) is determined by an infinite sequence of bits. 

Note also that the dark pattern may be either connected or not. The latter happens if there exists a 
"separating line" (a vertical or horizontal line that does not intersect any dark square). The dark pattern 
in these cases has 2 or 4 connected components separated by either a horizontal or vertical line, or by an 
infinite cross. For the case of one separating line we require it to be of uniform color (either light or dark). 
For the case of two separating lines they must form a dark corner (four possible orientations). 

Looking at some non-separating line, we see that it consists of alternating dark and light segments of 
length 2^^+' where k is the rank of dark squares adjacent to it. We say that this line has rank k (is a ^-line). 

We assign infinite rank to separating lines. The non-connected case (when separating lines exist) is 
called the degenerated case in the sequel and requires special treatment, see Subsection [ 



Proposition 1 There exists a palette and a projection of its colors into {dark, light} such that every tiling is 
projected onto some pattern of the described type. 



See MLevin 0411 and MDurand Levin Shen 0411 for the proof. This palette P (+palette, actually) provides 
two orientation bits which will help us below. These bits on each edge x show vertical and horizontal 
direction to the nearest center of the dark square with border co-linear to x. These bits form distinct crosses 
at the intersections of lines of the same rank, of adjacent ranks, and of more distant ranks. In a more informal 
language (that will be used in the sequel) one can say that each edge on a dark square "knows" {i.e., this 
information is encoded in its color) whether it belongs to the left or to the right half of the square. The same 
is true for the lower and upper half of the square (and vertical edge). The comer node "knows" {i.e., this 
information is encoded in the neighbor colors) that it is a corner node, etc. 

To provide more formal description of the pattern, it is convenient to use a kind of 2-adic coordinates. 
Consider lines that go in-between 2x2 squares (one line per four cells). Taking them as reference lines, we 
provide "modulo 4" coordinates, or just 4-coordinates, as shown in Figure|4] 

The same can be done modulo 8 for rank 2 squares, as shown in Figure [5] 
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Figure 4: 4-coordinates and rank 1 squares 



Figure 5: 8-coordinates and rank 2 squares 



Note that 8-coordinates are consistent with 4-coordinates (two last bits of the 8-coordinate form the 4- 
coordinate). We can then consider 16-coordinates, 32-coordinates etc. They extend each other, and for each 
point of the grid we get a 2-adic coordinate that is an infinite (to the left) sequence of bits. 

Vertical sides of rank k squares have A;-coordinates . . . 10*^^' ; the same is true for ^-coordinates of hor- 
izontal sides. So we can assign rank to vertical and horizontal lines (1 plus the number of zeros at the end 
of their coordinates). Lines of rank k contain sides of rank k squares. Each line has some uniquely defined 
rank, except for the line with zero coordinates. This line can exist or not depending on the pattern (this is 
the separating line we mentioned above). 

The centers of rank k squares have coordinates that end with k zeros, i.e., lie on the rank {k + 1) lines. 
Other features of the pattern can be also easily expressed in terms of coordinates. For example, a vertical 
grid line with coordinate x intersects (the interior of) rank k squares if and only if last ^ + 1 digits of x belong 
to the open interval (010*^"^ 1 10*="' ). 



6 Proof: Stripes and Grids 

Let us start with some informal remarks. The high complexity of tilings comes from an input sequence I, 
horizontal and infinite in both directions. Each bit occupies a vertical line. A Turing Machine (TM) verifies 
that / has no low complexity segments. This computation represented by tilings as space-time diagrams. 

As it was done for the origin-constrained case, the configuration of a TM (the contents of its tape 
including the head position) is represented by colors of horizontal edges. Their shifts in the vertical direction 
represent time evolution. The consistency of states in subsequent moments of time is achieved via vertical 
edges that carry the state information from one horizontal line to another. The correctness of state transitions 
is assured by a palette that restricts the coloring of crosses of these vertical and horizontal lines. 

In the origin-constrained case the whole tiling represented one computation. Now, instead, we arrange 
infinitely many coexisting and interacting computations. It is not a problem to combine two computations 
at the same location: the Cartesian product of two finite alphabets is still finite. But this cannot be done for 
infinitely many computations. Instead, they are separated in space and time so that each edge is used only 
by a limited number of them. All the computations should then communicate with each other to check that 
every substring of the input sequence has high complexity. 

The organization of these processes "formats" the plane using the self-similar Block Pattern (described 
above). This formatting is used to arrange space for infinitely many "computations". Each computation is 
performed by a subgrid that consist of finite number of (infinite) vertical lines and infinite number of (finite) 
horizontal lines arranged as in Fig. [6] Their intersection points are called nodes of the subgrid. 
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Figure 6: Subgrid for one computation 



Each horizontal line is divided by nodes into segments (^i, . . . ,s„). Each segment carries one symbol 
of TM tape or the state of one cell in the cellular automaton. The changes happens in nodes only (both for 
horizontal and vertical lines). All this can be: 

• organized locally if each edge of the subgrid knows its place in the subgrid (whether it is at the node, 
lies on the left/right boundary, or between nodes, etc.). 

• used in a usual way to simulate computations of TM (or cellular automata) with the tape of fixed size. 



Note that the "physical" distances between the grid Unes can be arbitrary, they do not affect at all the 
computation performed on the grid. (In fact all the vertical distances will be the same, but not the horizontal 
distances. This is somehow shown in Figure |6l) 

Note also that the edges included in the grid do not know how far they are from the nodes they connect 
(it is not needed and also there is not enough colors to encode this). 

Now we describe how the subgrids are localized. Let us introduce some terminology. Each dark square 
of rank k is included in a twice larger k-block. For each k, the plane is split into ^-blocks. A bi-infinite 
column of vertically aligned ^-blocks forms a k-stripe (see Fig. IT]). 

The borderlines between ^-blocks have 2-adic coordinates that end with k+l zeros. 

Each fc-stripe is a union of two {k— l)-stripes, called its children (see Fig. [8]l. (For example, 3-stripe 
[. . . 00000, . . . 10000] that hes between vertical hnes with coordinates . . . 00000 and . . . 10000 is the union of 
two 2-stripes: the left is [. . . 00000, . . . 01000], the right is [. . . 01000, . . . 10000]. 
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Figure 7: Grid of /c-blocks and ^-stripe 



Figure 8: Stripe and its two children 



We provide for each stripe a subgrid that is located inside the stripe. (This subgrid hosts a computa- 
tion that is finite in space but infinite in time.) These computations are not completely independent: each 
computation communicates with its parent computation (located in the parent stripe) and its two children 
computations (located in children stripes). The communication is implemented by sharing some vertical 
lines, communication hnes. There are three communication lines in each subgrid: the center line and the 
vertical lines that contain the vertical side of ^-square; the latter two lines are the leftmost and rightmost 
lines in the subgrid and are called "border lines". 

Note that the center line of /c-square is at the same time the border line for the k + 1 -level subgrid. Using 
the center line, /[-computation can communicate with its parent {k+ 1) -computation, and using the border 
lines, ^-computation can communicate with its two children {k — 1) -computations. 

We need also to specify the other vertical lines that are included in the /:-level subgrid. They are called 
k-channels and lie between the border lines (see below about their exact location). The horizontal lines of 
the subgrid, called k-tapes in the sequel, are just bottom lines of /:-squares (see Fig.©. 
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Figure 9: Horizontal and some vertical subgrid lines for a ^-stripe 

7 Designation of ^-channels 

Designating k-charmeh, we should have in mind that: 

(1) Each vertical line should be shared by a limited number of computation subgrids (in fact, three in 
the construction explained below: it can be a communication line in two subgrids and a channel in the third 
one). 

(2) There should be sufficiently many /:-channels to provide enough space for the computation performed 
by a subgrid. (In our construction the k-level subgrid has 0(2'''^) vertical lines, which is about the square 
root of its geometric size.) 

(3) Each node should know its role in every subgrid it belongs to. (Since the number of subgrids is 
limited, this is a finite amount of information that can be encoded in the finite number of colors. What is 
important, we need the correct information be enforced by local rules.) 

Let us explain how all three goals can be achieved. First, let us agree that we have two types of dark 
squares, say, red and blue squares, and the colors alternate (so Ik-squaies are red and {2k + l)-squares 
are blue or vice versa). This is very easy to arrange: an additional bit distinguishes between red and blue 
squares, and this bit should differ for two intersecting dark squares (note that if two squares intersect, their 
ranks differ by 1). 

Then for a vertical line we define its color (red or blue) as the color of the square whose side it contains. 
Since the vertical sides of a ^-square have coordinates . . .OlO'^^^ and . . . 110*^^^ the color of a vertical line 
depends on whether the number of trailing zeros is even or odd. (The color is defined uniquely for all lines 
except for the separating vertical line if it exists in the pattern; the separating line can have arbitrary color.) 
Note that we can easily distribute the color along the line, so each point on the line knows the line color. 

Now the rule: 

for each line L we look for the smallest square of the same color that intersects L (not taking 
into account the square that has L as its border); if this square is of rank k, the L line is declared 
to be /:-channel and belongs to the computational subgrid for the corresponding /:-stripe. 
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In other terms, consider a line of rank k. It is a border line for ^-squares. The construction guarantees 
that it is a center line for {k — l)-squares and does not intersect smaller squares. So we should look for 
squares of rank k + 2,k + A etc. until we find a square that intersects this line. (Note that rank k line cannot 
go through the center or along the sides of those squares.) 

For 2-adic coordinates: first we find the rank of the line looking at trailing zeros. Rank k means that 
there are ^ — 1 trailing zeros, i.e., the coordinate ends with 10^^^. Then we split bits on the left into 2-bit 
blocks, as shown in Figure [TOl Going from right to left, we find the first block that contains 01 or 10 (this 
means that the line intersects the corresponding square). 
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Figure 10: Finding the square 

So we see that goal (1) is achieved. 

To estimate the number of ^-channels in a given k-suhgnA, we can either use the coordinate description 
or geometric argument. The coordinate description shows that we can use blocks 00 or 11 after the 01/10 
block and the trailer of the form 1 ... 0. This gives 2^'^"*"^'^') options for ^-squares. (For each of k/2 + 0(1) 
levels we exclude two of four possible blocks 00, 01, 10 and 11, i.e., half of the lines.) 

We can count also the ^-channels for a given ^ in a top-down fashion. Each ^-square has two {k—\)- 
children of the opposite color and four {k — 2) -grandchildren of the same color, see Figure [TT] (This figure 
does not keep the vertical distances since only horizontal positions matter now.) Two grandchildren (and all 
their descendants) lie outside the zone of ^-square (i.e., on the left or on the right of /:-square). Two other 
provide four /c-channels that are lines of rank k — 2. 
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Figure 1 1 : Grandchildren and their grandchildren 

Each of these two grandchildren has four grandchildren; two of them are shadowed by {k — 2)-squares 
(and produce {k — 2) -channels, not ^-channels); each of two other produces two /^-channels, so we get 8 
^-channels that are lines of rank k — A. 

We continue by induction and conclude that our /^-square has A' descendants of rank k — 2t; some of 
them are shadowed by squares of intermediate level (together with the whole stripe), some lie outside the 
zone of the initial /c-square (together with the whole stripe), and 2' (together with the whole stripe) are not 
shadowed and lie inside the zone (together with the entire stripe) producing 2'+' ^-channels being lines of 
rank k — 2t. 

So the total number of /c-channels in the zone of some A;-square is 4 + 8 + 16 + ..., and this sum has 
k/2 + 0(1) terms, so it is equal to 0(2*^/^). The goal (2) is achieved. 

For (3), let us look at some vertical line. It knows its color. Also the points where it intersects the squares 
of the same color are locally known. We can consider them as "brackets" (opening bracket means that line 
comes in the square, and closing bracket means that is goes out). So we reduce our task to the following 
problem: having a correct bracket structure on a line, find the innermost brackets. It is easy to do by local 
rules, if each brackets sends a signal in the outside direction: the innermost bracket is the bracket that does 
not receive that signal. 
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8 Proof: Computational Subgrids and their Power 

Looking at a computational subgrid, we may ignore the rest of the plane as well as the geometric parameters 
of the embedding of this subgrid (distances between the lines etc.)- For us it is just a vertical stripe that 
obeys some local rules (rules for the left/right boundary could differ). 

Such a tiling represents the time-space diagram of a finite cellular automaton (finite number of cells that 
change their state depending on the previous states of themselves and of their neighbors, according to some 
rule which is the same for all automata except for the leftmost and rightmost one, who have special rules). 

This confronts us with the problem we started with: how to initiate a computation? But now the situation 
is different: we work in a stripe of a finite size, so the leftmost and rightmost cells know that they are on the 
boundary, and this allows us to restart computation "once in an exponential while" using a counter. 

This type of self-stabilization is easy to achieve. We may simulate a time-space diagram of a Turing 
machine. To ensure that a head of TM exists and is unique, we may require that some bit is at the left end, 
is 1 at the right end, is monotonic (local rule) and the place where the bit changes behaves like a head of 
TM. This machine can perform counting in a positional number system adding 1 to the counter all the time. 
When an overflow happens, we have to restart some other computation simulated in parallel by the stripe. 
If the base of our positional number system is large enough, the counting process takes more time that the 
other computation we simulate (if the latter computation does not repeat itself). 

Let us illustrate this technique using the model example of an isolated stripe. 

Consider a vertical stripe (finite in horizontal direction and bi-infinite in vertical (temporal) direction. 
Assume that left and right borders of the stripe have special "left" and "right" colors. We want to tile the 
stripe with tiles from a given tile set (respecting the border colors). 

Let us assume also that all tiles of our palette are divided into two types (0-tiles and 1 -tiles) and tiling 
rules guarantee that all tiles on a vertical line have the same type. This guarantees that each vertical line in 
a tiling carries one bit (its type) and thus each tiling of stripe of width w determines a bit string of length w. 

So for each palette T we get a set of strings Lr that corresponds to all T-tilings of stripes (strings of length 
n in Lt correspond to the tilings of the stripe of width n). 

Proposition 2 1. For every tile set T the language L^- belongs to PSPACE. 

2. Every language L that is decidable in linear space can be represented as L^ for some tile set T. 

Proof. Part [T] can be proved in the same way as Savitch theorem (NPSPACE = PSPACE). A T-tiling of 
an infinite stripe exists if and only if there exists a tiling of a w x /j rectangle (where w is stripe width and 
h G 2^^^') that has the same colors on top and bottom lines. Indeed, rectangles with this property can be 
combined into a (periodic) tiling of the entire stripe. On the other hand, there is only 2^^"') possible colorings 
in a horizontal section, so in every tiling of an infinite stripe identical sections appear at distance at most 
2^(h') Now we can write a recursive procedure that checks whether there exists a tiling of a rectangle of 
width w and height h with given top and bottom that runs in space (wXogh)^^^' and use it to determine 
whether a given string of length w belongs to L^. (Consider sequentially all possibilities for the colors along 
the middle line of the tiling and for each possibility make two recursive calls for the two parts of the tiling.) 

Part |2] uses self-synchronization technique explained above: since every computation with space 0'{w) 
terminates in time 2^^"'', we can superimpose the computation with a TM computation that keeps a ^(w)-bit 
integer (counter) in each horizontal line and increases it by 1 all the time. When an overflow happens, the 
main computation is "rebooted" in that line. As we have mentioned, this rebooting procedure gives the main 
computation enough time to terminate. 

This proposition is not directly used in the proof of main theorem. It is presented here as an illustration 
of the self-stabilization technique used in in our main construction together with other key ingredient, the 
hierarchical communication between the stripes. D 
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9 Proof: Hierarchy of Computations 

We have seen that a subgrid can compute every predicate that can be computed in linear (in its effective 
width: 0(a//V) for square with side N) space. 

However, our construction of tiling with linear complexity of squares will use subgrids in a more sub- 
tle way: different computations communicate with each other and therefore become parts of some global 
computation. Let us explain how it is done. 

9.1 Input Bits 

We assume (as we have done in the constrained case) that each vertical line carries one bit (that propagates 
vertically). Therefore, tiling determines a (horizontal) bi-infinite sequence of bits. Our goal is to guarantee 
that this sequence does not contain substrings with low Kolmogorov complexity (in the same way as for 
origin-cons ti^ained case). 

9.2 Zones of Responsibility 

Recall that computation subgrid based on rank k squares was located in the middle part of a stripe twice 
wider than the squares themselves. This stripe contains 2N vertical lines (and input bits) and we say that 
these lines and bits are in the "zone of responsibility" of this subgrid. Figure [8] shows A;-stripe that is the 
zone of responsibility for a computational subgrid based on the large square in the middle; this A;-stripe 
is the union of its two children who are {k — l)-stripes. These stripes are zones of responsibility for two 
computation subgrids based on the smaller squares. 

For each k the entire plane is divided into non-overlapping /c-stripes that are zones of responsibility for 
subgrids based on ^-squares. Each zone is divided into two children who are zones of responsibility for 
smaller subgrids; these zones are then divided into smaller zones etc. So we get a tree-like structure of 
degree 2 whose vertices are computation subgrids. Each has two children and one parent, except for the 
smallest ones that do not have children. 

9.3 Communication Between Stripes 

Communication between parent and child subgrids is easy to organize since parent and child share some 
line that can be used as a meeting point for the corresponding computations (Turing machines). Of course, 
the heads of two machines need not to be at the same time at the meeting point, and this creates some delay. 
Note that visibility of finite number of bits is enough for asynchronous communication (one of the bits 
can be used as "ready" flag while other are used as information bits), and the delay (^(a//V) steps for each 
transaction, if TM visits regularly the meeting points) is acceptable (see below). Therefore we assume that 
serial asynchronous communication between parent and its children is possible. 

9.4 Bit Servers 

It remains to explain what each subgrid computes. It runs in parallel (for example, using time sharing — or 
we can simulate two-head TM) two processes. The first process is called BitServer; the second one is called 
ComplexityCheck. Let us explain first what BitServer does. 

It serves requests about bits in the zone of responsibility of the subgrid where it runs. Such a request 
contains bit address (relative to the start of the zone) of logarithmic length and should be answered by 
providing a value of the input bit with given address. BitServer uses the most significant bit of the address to 
determine to which child it should forward the remaining part of the address, and then waits until this child 
provides a reply (which is then sent to BitServer's client). 
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This recursion stops at the lowest rank where each of (^(1) required input bits is at ^{l) distance from 
the computation, so we may assume that these bits are directly accessible. 

Note that BitServer is able to provide inputs bits from the entire zone of responsibiUty (even outside of 
the physical location of the subgrid) due to its children. 



9.5 Complexity Check 

BitServers are useless if nobody uses them, so we need to describe the second process, ComplexityCheck. 
This process runs in each subgrid and tries to check whether the sequence of input bits in its zone of respon- 
sibiUty has no substrings with small Kolmogorov complexity (as it was done for origin-constrained case). 
The ComplexityCheck process gets bits from the BitServer of the same computational stripe. BitServer 
interleaves requests from ComplexityCheck with external requests (see "Time bounds" below). 

The problem is that (compared to the origin-constrained case) each computation stripe has limited abili- 
ties: it can perform only \//V-space computations to check iff{N) bits. Therefore, each stripe should rely on 
higher ranks for complete check (the computation time needed to find that some string has low Kolmogorov 
complexity is not bounded by any computable function of string's length). 

This cooperation between ranks is indeed possible if ComplexityCheck is organized in a proper way. 
This process generates the list of "forbidden" string (strings with low complexity). Thus all ranks compute 
the same list in the same order (computation terminates when it meets time/space constraints). When a 
forbidden string appears in a computation it is tested against all substrings of the same length that are in 
the responsibility zone of the involved computation stripe. (This testing is performed by requiring bits from 
BitServer.) If a forbidden string is found in the input sequence, then the computation halts (making the tiling 
impossible). 

If some string has low complexity, then it appears in the list of forbidden strings and therefore the 
computational stripes of sufficiently high rank will have enough time first to generate it and then to check 
all substrings against it. 

Can we conclude now that all the substrings in the bi-infinite sequence of input bits have high complexity 
because they are ultimately checked in the computational stripes of all ranks? No. The problem is that the 
tree-like structure of computational stripes may consist of two disjoint parts that never meet. (This is a 
"degenerate case" discussed earlier.) But this does not hurt us because in this case each substring of the 
input (in the worst case) consists of two parts that are checked separately. Taking the longer part, we see that 
it is not forbidden and has high complexity. Therefore, every (sufficiently long) substring of input sequence 
has complexity at least en where n is its length and c is some constant. We can then increase c by combining 
several tiles into one bigger tile. 



9.6 Time Bounds 

The only thing that we still have to check is that all this communication and computation can be performed in 
v^-space (and exp(\//V)-time). Indeed, each bit address takes logarithmic space (and this is much smaller 
than A//V-space that is available). The depth of recursion is logarithmic. So if we assume that BitServer 
interleaves internal requests (from ComplexityCheck of the same rank) with external requests, the time to 
fulfill them will be still exp(€?(log)), i.e., polynomial. Note also that the slowdown induced by testing a 
forbidden string (when it appears) against all substrings in the zone of responsibility is polynomial (in the 
width of the zone), while the time bound is exponential. So this slowdown does not prevent the generating 
process from generating every forbidden string (at a high enough rank). 
This ends the proof of Theorem [U 
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10 Proof: Theorem ID 

Proof. To prove Theorem l2ll[ denote sn the space used by the algorithm of Section|3]that checks consistency 
of a border coloring of a square. Then S2n = sn + 0{N), and so, s^ = 0{N). 

The proof of l2l2l is essentially the same as the proof of Theorem [J with two additions addressing minor 
issues. First, the self-stabilization counter of Section [8] restarts computation very rarely, with exponential 
intervals. Thus, a meaningless computation can run for a long time before the re-initiation. It can fail to 
discover low complexity of the input, and thus allow it in a large tiled square. This is easy to remedy just 
by restricting the counters to (sufficiently large) polynomial values. Such counters are implemented by a 
constant number of unary integers. 

The second issue is that x may appear near the border of large N x N squares. Formally speaking, 
Proposition [T] says nothing about finite tilings. However, its proof (see MLevin 041 IDurand Levin Shen 041 ) 
guarantees that rank k structure can be distorted only near the border of the tiled region: for each k there 
exists some m{k) = ff{2^) such that the part of tiling that is m{k) tiles apart from the border, has a correct 
structure at rank k (i.e., for 2* x 2*^ squares). This can be proved by induction over k since the argument 
in MDurand Levin Shen 041 (that shows that 1 -tiles are grouped into 2-tiles in a regular way) uses only a 
small neighborhood. 

So the checking goes on in the internal part of the tiled region (square) and guarantees that the bit 
sequences there have no simple substrings whose simplicity can be established fast. The problem is to bring 
these complex bits to the border of the tiled region. This can be easily done with the following trick: let 
us overlap four constructions of the described type that propagate bits along the lines with direction (2, 1), 
(2,-1), (1,2), (1,-2) instead of vertical lines that we have used for bit propagation. For every point on the 
border at least one of these four directions brings us in the internal part of the tiled region (square), so the 
bits on the border are also complex. 

D 
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11 Turing Degrees of Tilings 

In this section we are concerned with Turing-degrees of tilings; we provide a simple direct proof of the 
following theorem. 

Proposition 3 For each palette T and for every undecidable set A there exists a T-tiling T such that A is not 
Turing-reducible to T. 

Corollary 2 For every palette T, there exists a T-tiling T such that T is not -hard. 

Proof. Let us consider the space 3^ of all configurations made of T-tiles (both tilings and configurations with 
tiling errors). This space can be considered as T^ and thus endowed with the product (Cantor) topology. 
The set t of local rules defines a closed (compact) subset C of ^ consisting of all tilings. This subset 
is an effectively closed subset (its complement is a union of an enumerable family of basic open sets that 
correspond to violations of local rules). By our assumption C / 0. 

Let M be some oracle machine that uses a tiling T G =>^ as an oracle. Let x be some input for M and a be 
some output value for M (i.e., a = or a = 1 if we consider machines that decide some set). Consider the 
set of all oracles T ^ ^z' such that M using T produces answer a on x. This set depends on M, x and a; we 
denote it by U{M,x,a). It is easy to see that U{M,x,a) is an effectively open set: we have to simulate M on 
input X for all possible oracles and look for all computation branches that end with answer a. In this way we 
generate basic open sets whose union is U{M,x,a). 

If C C U{M,x,a), then M produces answer a on input x for all T-tilings. The crucial observation: if it 
is the case, we can find it out eventually. Indeed, in this case the enumerable family of base open sets that 
form U{M,x,a) and the enumerable family of base open sets that form £^\C together form a covering of 
compact space 3^. For compactness reasons, finite number of sets are enough. Enumerating both families, 
we will discover this finite covering at some point. 

Now we can prove that there is no machine M that reduces the undecidable set A to every T-tiling. (This 
statement is a weak form of our theorem.) Indeed, this means that correct answer (we denote it by A(x)) 
is produced for every input x and every oracle T ^C, i.e., C C U{M,x,A{x)) for all x. But then we can 
compute A{x) without oracle by looking for all a such that C C U{M,x,a). The correct value A(x) will be 
found; no other one can appear since U{M,x,a) and U{M,x,a') are disjoint when a / a'. 

The next step is to use diagonal argument and find T-tiling T such that no machine decides A using T as 
an oracle. Let Mi ,M2, ... be the enumeration of all (oracle) machines. We construct a sequence 

Co D Ci D C2 D . . . 

of effectively closed sets such that Co = C, all Q are non-empty and M, does not reduce A to any of the 
oracles in C,. Then the intersection of all Q is non-empty because of compactness; every its element T is a 
T-tiling (since Co = C) and no machine reduces A to T. 

Assume that C_i is already constructed. There are two possibilities: 

(1) If C_i C U{M,x,A{x)) for all x, then A(x) is computable for the same reason as before (where we 
had C instead of C-i); to compute A(x) without oracle we look for a such that C_i C U{M,x,a). 

(2) If C,_i is not a subset of L'^(M,x,A(x)) for some x, then choose some x with this property and let 

C- = C,-_i\^(M,x,A(x)) 

Then C,- is non-empty, effectively closed and M does not produce correct answer A (x) with input x and any 
oracle T G C/. 

Note that the construction of Q is not effective (the choice of x is not effective) but this is not needed: 
the only thing we need is that each C,- is effectively closed (though not uniformly in /). D 
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